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Abstract 

In this paper, we investigate a class of hybrid stochastic heat equations. By explicit 
formulae of solutions, we not only reveal the sample Lyapunov exponents but also dis- 
cuss the pth moment Lyapnov exponents. Moreover, several examples are established 
to demonstrate that unstable (deterministic or stochastic) dynamical systems can be 
stabilized by Markovian switching. 

Keywords: Stochastic heat equation; Markov chain; Lyapunov exponent; Stabiliza- 
tion; Large deviation. 

Mathematics Subject Classification (2000) 60H15, 34K40. 



1 Introduction 



Stabilization of (ordinary) stochastic differential equations (SDEs) by noise has been 
studied extensively in the past few years, e.g., Arnold et al. [JJ, Has'minskii [6], Mao and 
Yuan [10], Pardoux and Wihstutz [UJ [12], Scheutzow [15] . Recently, there are also many 
works focusing on such phenomena for stochastic partial differential equations (SPDEs), 
e.g., Kwiecinska [7] and Kwiecinska [9] discussed by multiplicative noise such problems for 
heat equations and a class of deterministic evolution equations, respectively; some results 
on almost sure exponential stabilization of SPDEs were established in Caraballo et al. [3] 
by a Lyapunov function argument; stabilization by additive noise on solutions to semilinear 
parabolic SPDEs with quadratic nonlinearities was investigated due to Blomker et al. [2]. 

* E-mail address: jianhaibao@yahoo.com.cn, xuerong@stams.strath.ac.uk, C.Yuan@swansea.ac.uk 
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Also, there has been increasing attention to hybrid SDEs (also known as SDEs with 
Markovian switching and please see, e.g., the monographs [TOj ITS]), in which continuous 
dynamics are intertwined with discrete events. One of the distinct features of such systems 
is that the underlying dynamics are subject to changes with respect to certain configurations 
while the continuous-time Markov chains are used to delineate many practical systems, where 
they may experience abrupt changes in their structure and parameters. 

It should be pointed out that there are some papers discussing the almost sure exponential 
stability and the pth moment exponential stability of stochastic heat equations without 
Markov switching, e.g., Kwiecinska [TJ |9] and Xie [17]. However, hybrid SPDEs, e.g., 
hybrid stochastic heat equations, have so far little been studied. In this paper, we are 
mainly interested in finding explicit formulae of solutions for a class of hybrid stochastic 
heat equations, and compute explicitly the sample Lyapunov exponents as well as the pth 
moment Lyapunov exponents. In particular, due to the involvement of Markov chains, it is 
much more complicated to study the pth moment Lyapunov exponents of hybrid stochastic 
heat equations, and our results can not get straightforward from [8j fl~7] . To cope with the 
difficulties arising from the Markov switching, large deviation technique has been used in 
this paper. For large deviation of Markov processes, we refer to, e.g., Donsker and Varadhan 
[I] , Wu PS] and the references therein. On the other hand, we also use our theories to reveal 
the stabilization of (stochastic) dynamical systems by Markovian switching. 

The organization of this paper will be arranged as follows: In Section 2 we recall some 
notation and notions, and give an existence-and-uniqueness result for hybrid stochastic heat 
equations. We investigate, in Section 3, the explicit formulae of solutions for hybrid stochas- 
tic heat equations, and, in Section 4, the sample Lyapunov exponents, where two examples 
are constructed to show that Markovian switching can be used to stabilize unstable stochas- 
tic dynamical systems. The last section reveals by the large deviation principle the pth 
moment Lyapunov exponents. 



2 Preliminaries 

Let {fl, J 7 , {J r t}t>o^} be a complete probability space with a filtration satisfying the 
usual conditions, and B(t), t > 0, a real- valued Brownian motion defined on the above prob- 
ability space. For a bounded domain CcI" with C°° boundary dO, let L 2 {0) denote the 
family of all real-valued square integrable functions, equipped with the usual inner product 
(/,<?> := J f(x)g(x)dxJ,g G L 2 (0), and the norm ||/|| := (J Q f 2 (x)dx)\ f G L 2 (0). 
Let A := Y^h=i ^2 ^ e the Laplace operator, with domain T>(A) := Hq((D) fl H 2 (0), where 
H m (0),m = 1,2, consist of functions of L 2 (0) whose derivatives D a u of order \a\ < m are 
in L 2 (0), and H™(0) is the subspace of elements of H m (0) vanishing on dO. Furthermore, 
let {e n } n >i, forming an orthonormal basis of L 2 (0), and {A n } n >i f oo be the eigenvector 
and eigenvaue of —A respectively, namely 

- Ae n = X n e n . (2.1) 

Thus, for any / G L 2 (0), we can write / = J2n=i /™ e ™> where /„ := (/, e n ). 
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Let M + := [0, oo) and N be some positive integer. Let {r(t),t G R+} be a right continuous 
Markov chain on the probability space {Q, J 7 , {J-"t}t>o, P} taking values in a finite state space 
§ := {1, 2, N}, with generator T := (ji^NxN given by 



F(r(t + A) = j\r(t) = i) = 



7y A + o(A), 
1 + 7l4 A + o(A) 



if * J) 
if z = j, 



where A > and 7^ > is the transition rate from i to j, if i ^ j; while 7^ = — Ylj^i lij- 
We assume that Markov chain r(-) is independent of Brownian motion -B(-). It is known that 
almost every sample path of r(t) is a right continuous step function with a finite number of 
sample jumps in any finite sub-interval of R+. We further assume that the Markov chain 
r(t) is irreducible. This is equivalent to the condition that, for any i,j G §, one can find 
finite numbers ii,^, ■•• ,4 G § such that 7i,i 1 7i 1) i 2 • • -7i fc ,j > 0. The algebraic interpretation 
of irreducibility is ran(T) = N — 1. Under this condition, the Markov chain r(t) has a unique 
stationary probability distribution n := (71*1, 7T2, • • ■ , ttn) which can be determined by solving 
the following linear equation 7iT = subject to J2f = i = 1 and ttj > 0, Vj G S. 

In this paper we consider hybrid stochastic heat equation: 



Here u° is a D(v4)-valued J-cr m easurable random variable such that E||m°|| p < 00 for any 
p > 0, and independent of r(-) and B(-). Moreover, a, (3 are mappings from S — > R and we 
shall write := a(i), 0i := (3{i) in what follows. In general, u(t, x) is referred to as the state 
and r(t) is regarded as the mode. In its operation, hybrid system will switch from one mode 
to another according to the law of Markov chain. In this paper, we shall write u(t) := u(t, •), 
and u := {u(t)} t& R+- Hence, for each t > 0, u{t) is an L 2 (C)-valued random variable while 
u is an L 2 ((9)-valued stochastic process. Let us fix an interval [0, T] for arbitrary T > and 
recall the definition of solution to Eq. (12. 2p from Da Prato et al. |13j . 

Definition 2.1. An L 2 (0)-valued predictable process u = {-u(t)}i e [ 0) T] is called the solution 
to Eq. (12. 2p if the following conditions are satisfied: 

(i) u G C([O,T];L 2 (0)) and, for any t G [0,T], u{t) G V(A) a.s.; 

(ii) Stochastic integral equation 



holds a.s. for any t G [0, T] and x G O. 

Theorem 2.1. Eq. (12. 2ft admits a unique solution u = {u(t)}tm + such that E||w(t)|| p < 
00, t > 0,p > 0. 




(2.2) 



u(t, x) — u (x) + / [Au(s, x) + a(r(s))u(s, x)]ds + / (3(r(s))u(s, x)dB(s) 
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Proof. Recall that almost every sample path of r(-) is a right-continuous step function with 
a finite number of sample jumps in any finite time. So there is a sequence {rfc}fc>o of stopping 
times such that r = 0, lim^oo Tfc = oo a.s. and r(t) = r{jk) on < t < tu+i for Wk > 0. 
Let T > be arbitrary . We first consider Eq. (12. 2p on t G [0, T\ A T) which becomes 



By [3 Proposition 1], Eq. (12T2]) has a unique solution u G C([0, n A T]; ^ 2 (C)) and G 
V(A) for t G [0, n A T] a.s. while E||u(ri AT)|| P < oo. Setting := u(nAT,x), we next 

consider Eq. (12.21) on t G [ti A T, T2 A T) which becomes 



Again by [3 Proposition 1.], Eq. (12.21) has a unique solution u G C([tl A T, r% A T]; L 2 ((9)) 
and G for f G [n A T, r 2 A T] a.s. while E||u(r 2 A T)\\ p < oo. Repeating this 

procedure, we see that Eq. (12.21) has a unique solution u G C([0, T}; L 2 (0)), and, for any 
t G [0,T], G T>(A) a.s. while E||m(T)|| p < oo. Since T is arbitrary, the proof is complete. 
□ 

We conclude this section by defining the sample Lyapunov exponent and the pth moment 
Lyapunov exponent for the solution of Eq. (12. 2p 

Definition 2.2. The limit 



is called the pth moment Lyapunov exponent. 

If A(u°) < a.s. for any initial data u° (obeying the conditons imposed above of course), 
then any solution of Eq. (12. 2p will converge to zero exponentially with probability one. 
In this case, we say that the solution of Eq. (12. 2 p is almost surely exponentially stable. 
Similarly, if 7 p (m°) < for any u°, then the solution of Eq. (I2.2p is exponentially stable in 
the pth moment. 





Au(t, x) + a(r(ri))w(t, x) + f3(r(r 1 ))u(t, x)B{t), 



xeO; 
x G dO; 
x G O. 



A(u°) :=limsup-log(||u(t)||) 



is called the sample Lyapunov exponent, while the limit 
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3 Explicit Solutions of Hybrid Stochastic Heat Equa- 
tions 



Let us first discuss hybrid stochastic heat equation with external forces and Dirichlet 
boundary conditions 

^§f± = Av{t, x) + a{r(t))v(t, x), x G O, t > 0; 
v(t,x) = 0, x G dO, t > 0; (3.1) 

v(0,x) = u°(x), x G O. 

In the sequel, we shall denote u° n := (u°,e n ) for n > 1. In general, u° n is a random variable 
but it becomes a (non-random) number if u° is deterministic. When u° is deterministic and 
u° 7^ 0, we set n := inf{n : u Q n ^ 0}. 

Theorem 3.1. The unique solution of Eq. (13. ip has the explicit form 



)(t, x) = exp \ — X n t + / a(r(s))ds \u° n 

n=l 1 JO ■> 



e n (x), t>0,xeO. (3.2) 



Proof. Clearly, by Theorem 12.11 we can conclude that ( 13. ip has a unique solution v = 
{v(t)} t >o- Let {rk}k>o be the same as defined in the proof of Theorem 12.11 For t G [0, T\) 
Eq. (13.11) can be written as 

= Av(t,x) + a(r(0))v(t,x), x G 0\ 
v(t,x) = 0, xedO; 
v(0,x) = u°(x), x G O. 

It is well known (see, e.g., [7J [H]) that this heat equation has explicit solution on t G [0, Ti] 

oo 

v (t,x) = ^exp{(-A„ + a(r(0))t)Ke„(x). (3.3) 

n=l 

Set f 1 (x) := v(ti,x) and consider Eq. (13. ip for t G [ri,r 2 ), namely 

?^ = Av(t,x) + a(r(r 1 ))v(t 7 x) 1 x G 0\ 
v(t,x) = 0, x G dO; 

v(ti,x) = v x (x), X G O. 

Again this heat equation has explicit solution on t G [t%, r 2 ) 

oo 

v(t,x) = ^exp{(-A n + a(r(ri))(t - Ti))}(v l ,e n )e n (x). (3.4) 

n=l 
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Letting t — T\ in (I3.3P and substituting v 1 into (13 .4p . we derive that 

oo 

v(t,x) = ^exp{(-A„ + a(r(ri))(t - n))} 

,=i 

oo 

y^exp{(-Aj + a(r(0))ri)}M°e i ,e n ^e n (x) 

oo 

= ^exp{(-A n + a(r(ri))(t - n))} exp{(-A n + a(r(0))ri)}M°e n (x) 

n=l 

oo 

= J^exp{-A n t + a(r(0))n + a(r(ri))(t - ri)}M°e n (x) 

n=l 

oo „j 

= ^exp|-A„t+ / a(r(s))ds jw°e n (x). 

n=l ^° 

Repeating this procedure, we obtain the required assertion (I3.2p . The proof is complete. □ 
Theorem 3.2. The solution of Eq. (13. ip has the following properties: 

(1) If u° is deterministic and u° ^ 0, then 



1 ^ 
lim -log(||w(t)||) = -(A no - y^KjOij) a.s. (3.5) 

t— >oo t \ / 



In particular, the solution of Eq. (13.1 ft with initial data u° will converge exponentially 
to zero with probability one if and only if 

JV 

K - Yl W > °- 

(2) For any initial data u°, 

1 N 
limsup - log(||u(t) ||) < — ( Ai — y KjCtj) a - s - (3-6) 

In particular, the solution of Eq. (13. ip is almost surely exponentially stable if 

N 



3=1 



Remark 3.1. In case (1) above, since A no depends on the initial data u°, we only know the 
asymptotic behavior of the solution with initial data u°. However, in case (2), the estimate 
on the sample Lyapunov exponent holds for any initial data whence the solution of Eq. (13. ip 
is almost surely exponentially stable if the right-hand-side term of ( 13. 6p is negative. 
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Proof. (1) For any t > 0, it follows from (13. 2 p that 
1 



t log(|Ki)||) = -log(^ |exp{-A no t+ / a(r(s))ds}u° n ) (3.7) 

n=n.Q ® 

< ~( - A no t + J\{r{s))ds + Iog(ll«°ll)) 



2\ 1/2 



'0 

since X n ,n > 1, are increasing. On the other hand, we can also derive that 

00 i rt 2n 1/2 



1 1 /* 

-log(Kt)||) = -log(^ |exp{-A no t+ / a(r(s))ds}u° n 

n=no ® 



(3.8) 



Letting t — > oo in both ( 13. 7p and (13. 8p and taking into account the ergodic property of 
Markov chains, we obtain the first assertion (13. 5p . 

(2) For any initial data u°, we observe from ( 13 .7p that 

ilog(IKf)H) <j(- \it + jf a(r(a))cfc + ]og(||u | 

Therefore, the ergodic property of Markov chains yields the other assertion (13. 6p . □ 

Example 3.1. Let r(t),t > 0, be a right-continuous Markov chain taking values in § = 
{1, 2, 3} with the generator 

/ -2 1 1 

r = 3 -4 i 

\ 1 1-2 

It is straightforward to see that the unique stationary probability distribution of the Markov 
chain r(t) is 

l i r 

15' 5' 3 



7T 



Let us consider hybrid heat equation 

■vfrftWitft >A t n t (= (n ttV 

(3.9) 



= Av(t, x) + ot(r(t))v(t, x), t > 0, x G (0, vr); 
u(t, 0) = tt) = 0, t > 0; v(0, x) = u°(x),x G (0, 7r), 



where u°(x) = \J2pK sinx for x G (0, 7r). Let a(l) = 0.1, a (2) = 1.5, a (3) = 0.2. Moreover, 
we recall that e n (x) = a/2/7t sin m, n = 1, 2, 3, • ■ ■ , are eigenfunctions of —A, with positive 
and increasing eigenvalues A n = n 2 , and form an orthonormal basis of L 2 (0). 

To see what this example shows us, we regard Eq. ( 13 ,9p as the result of the following 
three equations 

= Av(t, x) + ±v(t, x), t > 0, x G (0, 7r); . . 

v(t,0) = u(*,7r) = 0, i > 0; v{0,x) = u°{x),x G (0,vr), 



^) = Av(t,x) + \v{t,x), t > 0,x G (0,vr); 

V- 

and 



v(t, 0) = v(t, 7r) = 0, t > 0; v(0, x) = u°(x), x G (0, vr) 



^fi- = Av(t,x) + lv(t,x), t > 0,x G (0,tt); 

u(t, 0) = tt) = 0, t > 0; v(0, x) = u°(x), x G (0, tt), 



(3.12) 



switching from one to another according to the movement of the Markov chain r(t). We 
observe that the solutions of Eq. (13.101) and Eq. (I3.12p will converge exponentially to zero 
since the Lyapunov exponents are —0.9 and —0.8, respectively, while the solution of Eq. 
(13.111) will explode exponentially since the Lyapunov exponent is 0.5. However, as the result 
of Markovian switching, the overall behaviour, i.e. the solution of Eq. (13. 9p will converge 
exponentially to zero, since, by Theorem I3.2[ the solution of Eq. (I3.9p obeys 

limilog(|K*)||) = ~. 

t-too t 15 

To get the explicit expression for the solution of Eq. (12. 2p . we need one more result. 
Lemma 3.1. [TQl Theorem 5.22, pl82] For any positive integer n and t > 0, hybrid SDE 

dz n (t) = (-A n + a(r(t)))z n (t)dt + 0(r(t))z n (t)dB(t) (3.13) 
with initial condition z n (0) = has the explicit solution 



1 



z n (t)=u° n exp{-\ n t + J [a(r(s))--/3 2 (r(s))\ds + J 0(r(s))dB(s)j. (3.14) 

We can now state the explicit formula for the solution of Eq. (12. 2p . 
Theorem 3.3. The unique solution of Eq. ( 12. 2 p has the explicit form 

u{t,x) = Y^z n {t)e n {x) =v(t,x)exp\ -- / (3 2 (r(s))ds + / (3(r(s))dB(s)\, (3.15) 
n=i ^ Jo Jo J 

where v(t, x) is the solution to ( 13. ip given explicitly by (13. 2ft . 
Proof. Set 

oo 

u(t,x) := ^2z n (t)e n (x). (3.16) 

n=l 

and note from (12. ip that 

oo 

Au(t,x) = - ^ X n z n (t)e n (x). 

n=l 
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Substituting f)3.13|) into (13.161) . we then compute 

u(t, x) = \ u° n e n (x) + / (-A n + a(r(s)))e n (x)z n {s)ds 

n=l ^ J 

+ J P{r{s))e n {x)z n {s)dB{s)} 

oo pt oo /■< oo 

= ^2u° n e n (x) - / ^ A n e„(x)2:„(s)(is + / a(r(s)) ^ e n (x)z n (s)ds 

n=l J° n=l J° n=l 

pt oo 

+ / P{r{s))Y^e n {x)z n {s)dB{s) 

J ° n=l 

= u°(x)+ / Au(s,x)ds+ / a(r(s))u(s, x)ds + / (3{r(s))u{ 1 x)dB(s). 



Consequently, u is a solution of Eq. (12.21) . While, by the uniqueness of solution of Eq. (12. 2p . 
we must have 



i(t,x) = ^z n (t)e n (x). 



?1=1 

Taking into account (13.141) . we obtain the desired explicit form (I3.15p . □ 



4 Sample Lyapunov Exponents 

Making use of the explicit solution of Eq. (12. 2p . we can now discuss its Lyapunov expo- 
nent. Let us now begin with the sample Lyapunov exponent. 

Theorem 4.1. The solution {u(t)} t > of Eq. (12.21) has the following properties: 

(1) If u° is deterministic and u° ^ 0, then 

1 N 1 

lim -log(||u(t)||) = -(K ~ J2 n i{ a i ~ 2^)) a ' S ' 



In particular, the solution of Eq. (12. 2 p with initial data u° will converge exponentially 
to zero with probability one if and only if 



(2) For any initial data u°, 



N 



1 N 1 

limsup-log(||«(t)||) < -(Ai -J2 n j( a 3 - 2^)) a ' S ' 

i=i 



In particular, the solution of Eq. ( 12. 2 p is almost surely exponentially stable if 



N 



Proof. It follows from (13. 15[) that 

ilog(||^(t)||) = ^{ log(||^(t)||) - |^ t /3 2 (^( S ))^ + ^ £ /5(^(^))^( s ) 
By the strong law of large numbers, e.g., [10J Theorem 1.6, pl6] 

i y* 

lim - / (3{r{s))dB{s) = 0, 

t^oo t J 

while by the ergodic property of Markov chains, 

i 1 r* 1 - 



3=1 

The desired assertions then follow from Theorem 13.21 □ 

In the sequel we set an example to demonstrate our theories and reveal that an unstable 
stochastic system can be stabilized by Markovian switching. 

Example 4.1. Let B(t) be a scalar Brownian motion and r(t) a right-continuous Markov 
chain taking values in § = {1, 2} with the generator T = (7^) 2X 2 ; 

-711 = 712 > 0, -722 = 721 > 0. 

It is straightforward to show that the unique stationary probability distribution of the 
Markov chain r(t) is 

/ x / 722 711 
7T = (TTi, 7T 2 ) = ■ , ■ 

\7ll + 722 7n + 722 

Consider stochastic heat equation with Markovian switching: 



^fi- = Au{t, x) + a(r(t))u(t, x) + 0(r(t))u(t, x)B(t), t > 0, x G (0, tt) 
u(t, 0) = u(t, n) = 0, t > 0; u(0, x) = 1^2/11 sin x, x G (0, 7r), 



(4.1J 



where a(l) = a, a(2) = 6, ,5(1) = c, ,5(2) = ti with a,b,c,d G R. Moreover, we recall that 
e n (^) = \/2/7r sin ra,n = 1, 2, 3, • • • , are eigenf unctions of —A, with positive and increasing 
eigenvalues A n = n 2 , and e n G ^(^4). Note that initial condition u(0,x) = sin x is 

deterministic and u\ = (y2/7T sinx, sin a;) = 1, which implies n = 1. By Theorem 

14.11 the unique solution w(t, x) converges exponentially to zero if and only if 

1 - (7Tiai + n 2 a 2 ) + -(vri/?! 2 + 7T 2 /3|) > 0. 
10 



That is, 

ai22 + 6711 < x + c 2 722 + ^ 2 7n ^ ^ 

7n + 722 2(711 + 722) ' 

As a speical case, let us set a — 2, b — 1, c — 1, d — 1 and 

-7n = 7i2 = 4, -722 = 721 = 7 > 0. 

Then the stochastic system (14. ip can be regarded as the result of two equations 

du(t, x) 
dt 

and 



Au(t, x) + 2u(t, x) + u(t, x)B(t), t > 0, x e (0, vr) (4.3) 



^ = Au(t, x) + u(t, x) + u(t, x)B(t), t > 0, x e (0, 7r), (4.4) 

with the Dirichlet boundary condition and initial condition, switching from one to the other 
according to the law of Markov chain. By Theorem 14.11 the solution to Eq.f l4.3p has the 
property 

lmilog(|Kt)||) = i 

t— yoo t L 

and the solution to Eq.f l4.4p has the property 

lim~log(|K*)ll) = -~- 

t— yoo Z L 

That is, the solution of stochastic system (14. 3 p explodes exponentially, and the solution of 
stochastic system (14. 4p converges exponentially to zero. However, by ( 14. 2p . the unique solu- 
tion u(t,x) of Eq.f l4.ip converges exponentially to zero if and only if < 7 < 4. This shows 
once again that Markovian switching plays a key role in the stability of hybrid stochastic 
heat equations. 



5 pth Moment Lyapunov Exponents 

Let us now turn to the discussion of the pth moment Lyapunov exponent. The pth 
moment exponential stability of stochastic heat equations without Markov switching has 
been discussed, e.g., in [21 EJ EJ [T7]. However, due to Markov switching, it is much more 
complicated to study the moment Lyapunov exponent of hybrid stochastic heat equations. 
To cope with the difficulties arising from Markov switching, large deviation techniques will 
be used in this section. 

In what follows, we recall some details with respect to large deviation, see, e.g., Donsker 
and Varadhan [1]. Let (X, 33, \\ ■ \\x) be a Polish space, and p(t,x,dy) the transition prob- 
ability of an X-valued Markov process Z{t) with Z(0) = x. Let Pt be a strongly continu- 
ous Markovian semigroup associated with Z(t), and define Ptf(x) := J x f(y)p(t,x,dy) for 
/ G C(X), the space of continuous functions on X. Let L be the infinitesimal generator of 
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the semigroup P t with domain @(L). Let ^# be the space of all probability measures on X. 
For any /x G define the rate function by 



J(A*):=- jpf / — (x) UW- (5-1) 

u>0,mGS> J x \ U J 

Let be the space of X- valued cadlag functions Z(t), < t < oo, with Z(0) = x. For each 
i>0,wefij, and Borel set J, the occupation time measure is defined by 

L t (u,A):=- [ I A {Z{s))ds. (5.2) 
£ Jo 

In other words, L(u,A) is the proportion of time up to t that a particular sample u; = Z(-) 
spends in the set A. Note that for each t > and each u, L(u,-) is a probability measure 
on X. 

Remark 5.1. For the Markov chain r(t), we remark that 

l r* 

X = S and L t (u),i) — - J I{iy(r(s))ds, i G §. 

Remark 5.2. For a continuous time Markov chain with finite state space and Q-matrices 
(qij)NxN, it is easy to see that the rate function has the following expression (see [3]) 

N 

7( M ) = - inf £ (5-3) 

Ui>0 ' ttj 

where /i is the probability measure on the state space {1, 2, • • • , N}. 

Lemma 5.1. [U Theorem 4] If $ is a real- valued weakly continuous functional on ^t, then 
lim ~ \og(E{exp{t<5>(L t (u, •))}}) = sup [$(//) - I(/x)] 

where L t (u),-) and /(/i) is defined by (15.21) and (15.3p . respectively. 

Theorem 5.1. Let p > 0. The solution to Eq. (12.21) has the following properties: 

(1) If u° is deterministic and u° ^ 0, then 

lim -log(E(||u(*)|H) = - P X no + sup { V)flr(0//(0 (5-4) 

^ 1=1 

where the supremum is taken over probability measures /x on §, = pcti+ ^Z fif , i = 
1, 2, • • • ,N and 7(/x) is defined by (15. 3p . In particular, the pth moment of the solution 
of Eq. (I2.2p with initial data u° will converge exponentially with probability one to 
zero if and only if 

N 



p\ no - sup i^2g(i)fi(i) - > 0. 
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(2) For any vP (which is independent of r(-) and B(-) as assumed throughout this paper), 



1 N 
lim sup - log(E(|K*)f)) < -pXt + sup { 9(i)Ki) ~ Hi*)}- 

i=i 



(5.5) 



In particular, the solution of Eq. (12. 2 j) is exponentially stable in the pth moment if 



-pXi + sup { 5^p(i)ju(i) - /(//)} < 0. 

i=i 



Proof. Recall that the solution of Eq. (12. 2p has the explicit form 



u(t, x) = v(t, x) exp 



f3 2 (r(s))ds + / 0{r{s))dB{s) 



(5.6) 



where 



v(t, x) 



oo „i 

5^exp|-A n t+/ a(r(s))ds j , it n e n (x) . 

n=l ^° 



It is well known that almost every sample path of the Markov chain r(-) is a right continuous 
step function with a finite number of sample jumps in any finite subinterval of M + := [0, oo). 
Hence there is a sequence of finite stopping times = r < T\ < • • • < f oo such that 
r(t) = Y^=o r ( T k)I[ T k,T k+1 )(f),t > 0. For any integer k > and t > 0, we compute 



\u(tAT k )\\ p = \\v(tAT k )\\ p exp 



t/\T k 



f3 2 {r{s))ds + 



tAr k 



pp(r(s))dB(s) 



|u(tA7]b)|| p f(tA7*)exp^ - 



P 



2 pt/\T k 



I3 2 {r{s))ds + 



tAr k 



pP(r(s))dB(s) 



k-l 



; (* A n)\\ p t(t a r k ) Yl Q(t), 

3=0 



where 



and 



f (t) = exp 



f p(p ~ 1) 
I 2 



/3 2 (r(s))cis 



Cj(t) = exp { - ip 2 /3 2 (r(t A r,))(t A r i+1 - t A r,) +p/3(r(t A T 5 ))[B{t A r i+1 ) - B(t A r,-)]}. 
Letting ^ = cr({r(-u)} u > , {-B(s)}o< s <t), by properties of conditional expectations, we have 



fc-i 



E(\\u(t A r k )\\ p ) = E[\\v(t A r k )\n(t A r,) J] &(t) 

fe-i 

= E{E(|KtAr Jfc )retAr Jfe )J]0(*) 

3=0 
k-2 

v(t A r fc ) \n(t A r*) J] (*)] ®((k-i(t) \Qt^) }. 



*A"r fe _i 



E 



i=o 
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Clearly, 



iGS 



where 



Cfc-i(*) = exp I - -p 2 & 2 (t A Tfc — t A r fe _i) + A r fe ) - £(t A 7*_i)]}, 2 G S. 

Noting that t Ar fc - tAr^ is £ tATfc ^-measurable and -B(t 2 ) — B(t\) is independent of ^tAr fc _ 1 
whenever t 2 > t x > t A Tfe_x, by [TOj Lemma 3.2, pl04], we can derive that 







= exp < 




- * A r fc _! 


= exp < 




- i A r fc _! 


= exp < 


-^p 2 /3f(tAT k 


- t A r fc _! 


= 1. 







|i2=tAT fc ,ti=tAT fe _ 1 



Hence, 



k-2 



E(\\u(t A r fc )|| p ) = E[\\v(t A r fc )|| p £(t A r fc ) JJOC*))- 

i=o 

Repeating this procedure, we obtain that 

E(||u(* A T fe ) f) = E(||u(t A T k ) \mt A r fe )). 

Letting k — > oo gives 

E(||i»(t)|n=E(||t;(t)ret)). 
(1) The intial data u° is deterministic and it ^ 0. Using (13.21) . we compute 



OO „f 

E(Kt)ra*)) = E(||X) ex p{- A » t+ / 

n=l ^° 



a(r(s))(isU°e ri f(t) 



e(|| ^exp{-A n t + / a(r(s))ds} 

n=no 

E ((E |exp{-A n t+ / a(r(s))ds}< 



n=no 



< ||n°fE(exp{ - p \ no t + J g(r(s))ds}^, 



(5.7) 



(5i 
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and 



g(r(s))ds} 
Therefore, by (15. 7p 

Iimilog(E(||u(*)|H) = -pA no +liinilogfE('ex P { / (y(r(s))ds))). (5.9) 
;-^oo t t-*oc t V V ^ Jo J / / 



Furthermore, note that 



o 



t rt 

g{r{s))ds = \ g(r(s))l {r{s)eS} ds 

D 

N 



1 f 

t ^2s{i)~ / l{i}(r(s))ds 

„■ 1 J 



1=1 
iv 

8=1 



Then it follows from Lemma 15.11 that 



If 1 N 

i iog ( E ( exp { y ^( r ( s )) rfs })) = ^{x^m*) - w 

where the supremum is taken over probability measures /ion§ and J(/i) is defined by (15. ip . 
(2) For any u° which is independent of r(-) and B(-), we observe from (15. 8p that 

-t 



E(\\v(t)\n(t))<E(exp{-p\it + J </(r(a))ds}||u°| 

= E(exp| -pAit+ / #(r(s))ds})E(||u°f 



Hence the desired assertion (15.51) follows from Lemma 15.11 □ 

Remark 5.3. Since the Markov chain r(t) with Q-matrix (7y)jvxAr, i,j 6§ is assumed to be 
irreducible throughout the paper, there exists a unique invariant measure n = (tti, vr 2 , • • • , n N ) 
such that 

N N 

J2 n ^iJ = and 5^ = 1. 

i=i j=i 

Letting /x be the invariant measure 7r and Mj, j 6 § be constants, together with the nonneg- 
ative property of rate function, it follows that 7(7r)=0. Therefore, 



limilog(E(||^)n)>-pA no +£; 9 
whenever tt is deterministic. 



t— >oo t 

i=l 



N 
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Remark 5.4. Let us reconsider Example 14.11 where r(i) is a right-continuous Markov chain 
taking values in state space § = {1,2} with the generator T = (7^)2x2: 

-7n = 7i2 = 1, -722 = 721 = q > 0. 

By computation, the invariant measure of the Markov chain is it = (^1,712) = {q/(q + 
1), l/(q + 1)). In what follows, we assume that, for some probability measure fio — 1 — 
6), < 9 < 1, on the state space S, 

a9 + 6(1 — 6) — I(no) > ani + bm, 

where g(l) = a > 0, g(2) = b > and g(i),i = 1, 2 is defined in Theorem I5.1[ that is, 

(a - b)6 + b > am + bn 2 + 6 + (1 - 6)q - inf \0— + (1 - %— 

Wl,W2>0 L U% U2 



= am + bir 2 + 9 + (l- 0)q - 2y/6(l-6)q. 

Recalling m = q/(q+ 1), vr 2 = l/(q + 1) and letting // = |, then the previous inequality can 
be rewritten as 

a + 6 > (q 2 - 2ql + 2q - 2q^ + l)/(3g + 1). (5.10) 

Since the right hand side of the inequality above tends to zero whenever q — > 1, then we can 
choose suitable q to satisfy (15.101) and further get 

2 2 

-p\ no + sup {^2g(i)fi(i) - I{n)\ > -pX no + ^9{i)n ~ 
M i=i i=i 

Since J(7r) = and A no = 1, the solution of Eq. ( 14.1 ft will explode exponentially with 
probability one to 00 provided that — p + 5^i=i g{i)^i > 0. 

So far we have assumed the Brownian motion is a scalar one. However, our theory 
can easily be generalized to cope with a hybrid stochastic heat equation driven by a multi- 
dimensional Brownian motion of the form as Xie [T7] . 

m 

= Au (t, x) + a(r(t))u(t, x) + £ ft(r(t))«(t, x)^), t > 0, a; e 0; 

»=i (5-11) 
x) = 0, t > 0, x E dO; u(0) = u°, 

where (i?i(t)), • ■ ■ ,B m (t)) is an m-dimensional Brownian motion, a, are mappings from 
§ — > R and we write /3y = /3i(j) for any j G §. Following the similar arguments to that of 
Theorems 14.11 and I5.1[ we can derive the following theorems. 

Theorem 5.2. The solution {u(t)} t >o of Eq. ( IS.lip has the following properties: 
(1) If u° is deterministic and u° 7^ 0, the sample Lyapunov exponent 

/^m -log(||u(t)||) = - (\ no -^TTifai - 2 a " s ' 
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In particular, the solution of Eq. ( 15. lip with initial data u° will converge to zero 
exponentially with probability one if and only if 

i=l 0=1 

(2) For any u°, the sample Lyapunov exponent 

1 N l "' 

limsup -log(||u(t)||) < -(Ai - ^iTiiai - ^J^J I I a.s. 

1=1 3=1 

In particular, the solution of Eq.( l5.11|) is almost surely exponentially stable if 

N ^ m 

i=i j=i 

Theorem 5.3. The solution {u(t)} t >o of Eq. ( 15. lip has the following properties: 

(1) If u° is deterministic and u° ^ 0, the pth moment Lyapunov exponent is 

1 N ( i\ m 

lim - log(E(||u(t) IH) = -p\ no + sup { £ (pa + £ - /(/.)}, 

M i=l j=l 

where the supremum is taken over probability measures /x on 8 and /(//) is defined by 
( 15. ip . In particular, the pth moment of the solution of Eq. ( 15. lip with initial data u° 
will converge exponentially to zero if and only if 

P x no - sup { jr (pa + - m} > o. 

* i=l j=l 

(1) For any u°, the pth moment Lyapunov exponent 

lim sup - lDg(E(||«(t)|n) < -p\i + sup { V (pa + ^—->- V - /(/*)}. 

1=1 3=1 

In particular, the solution of Eq. ( 15. lip is exponentially stable in pth moment if 

N 



-pA x + sup { (j» + ^2~^ S $)M0 " < 0. 

i=i j=i 
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